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This paper emphasizes on the development of an appropriate closed-loop 
control strategy for traditional portable duodopa pump (PDP); thereby 
ensuring an automated drug infusion without wearing off. In particular, a 
sigmoid proportional integral derivative (SPID) controller is adopted to 
control the blood plasma level of dopamine. The parameters of SPID 
controller are tuned using the adaptive safe experimentation dynamics 
(ASED) algorithm. The efficiency of the suggested SPID-ASED is evaluated 
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1. INTRODUCTION 

Parkinson’s illness is the most common age-related neurodegenerative disease after Alzheimer’s. 
Today, approximately seven to 10 million individuals around the world have Parkinson’s disease (PD) [1, 2]. 
PD is caused by the shortfall of nerve cells in the part of the brain called the substantia nigra which 
responsible for the production of dopamine. In the PD case, if the amount of dopamine produced in the brain 
starts to decrease or stop, it will cause less or no signal can be transmitted from transmitting neuron to 
receptor cell of patients in which caused an uncontrolled movement of the patient. Specifically, the 
movement disorder symptoms start to develop when around 80% of the nerve cells in the substantia nigra 
have been lost or when the dopamine level reduced until 20% [3]. To solve this problem, we can increase the 
dopamine level by using Levodopa. Levodopa is the best PD medication that passed into the brain and 
converts it into dopamine [4]. There are two ways to deliver the medicine (Levodopa) which are by using the 
oral method and the deep brain stimulation (DBS). Nowadays, the most effective method to deliver 
Levodopa is by using DBS because it can generate more stable plasma and fewer side effects. DBS work in a 
closed-loop drug infusion with a controller assisted by a controller tuning method to improve the control 
efficiency and performance of the system. This research important to find the best method to implement in 
the DBS system to help the patient survive in their daily life without any side effects especially caused by an 
overdose of Levodopa. By monitoring the level of dopamine in the safe range which is between 10-20 ng/mL 
for adults. 
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Recently, PID-tuned Ziegler-Nichols (ZN) has been utilized for portable duodopa pump system [5]. 
Here, an ultimate gain (Ku) and oscillation period (Pu) are being used to set the parameters of the PID 
controller. Although the tuning method based on ZN is very simple to use, it has many disadvantages, such as 
further fine-tuning, because the controller settings are aggressive, resulting in the final responses will produce 
a large overshoot and oscillatory responses. Besides poor performance for processes with a dominant delay, 
the obtained closed-loop is very sensitive to parameter variations. Therefore, in [5], it is shown that PID- 
tuned particle swarm optimization (PSO) has been used to overcome the problem of PID-tuned ZN. Note that 
PSO is an optimization algorithm based on artificial intelligence where particles swarm around in a multi- 
dimensional search space to obtain a good solution. Nevertheless, the significant limitation of the PSO 
proposed in [5] is that the it produces large computational load in obtaining the optimum PID controller 
parameters. The reason is that the computational load in every iteration is highly depended on the agents’ 
number. Moreover, the existing PID controller structure is still not enough to produce better control accuracy, 
while it is worth to explore a new modification of PID controller structure to the problem. 

Therefore, it encourages us to utilize a trajectory-based optimization since it produces less 
computational load. To date, there are variety of single agent-based optimization tools such as random search 
[6], simulated annealing [7], simultaneous perturbation stochastic approximation [8] and safe 
experimentation dynamics (SED) [9]. From reported work in [10], the adaptive safe experimentation 
dynamics (ASED) have shown to be the most effective trajectory-based optimization than other trajectory- 
based optimization tools due to less number of coefficients, memory-based framework (able to keep the best 
design parameter during the tuning process) and simple algorithm. On the other hand, there are many types of 
advanced PID have been proposed by many control researchers, such as PD-PID [11], fuzzy-PID [12, 13], 
PD based fuzzy sliding mode control [14], fractional-PID [15], neural-network-PID (NNPID) [16, 17], 
fractional-fuzzy-PID [18], kinematic model predictive control PID (K-MPC-PID) [19], integral separation 
PID (IPID) [20], variable structure PID [21] and also sigmoid-PID (SPID) [22, 23] controllers. Based on the 
reported advanced PIDs, the SPID is reported to be effective since the proposed method uses variable PID 
coefficients depending on error signal behaviour according to the sigmoid function. The sigmoid function 
allows nonlinearly compression of PID controller coefficients between the lower and upper bounds. In other 
words, the transition between PID boundary parameters takes place asymptotically and continuously through 
the use of exponential function characteristics. Hence, it is expected that the SPID can produce less overshoot 
with faster settling time as compared to the PID controller that can lead to better control performance 
accuracy. 

This study proposes a novel controller for a portable duodopa pump (PDP) which Sigmoid-based 
PID controller. The proposed controller is tuned using the ASED algorithm. Here, the updated controller 
parameter is improved to adapt to any variation of the cost function during simulation process. The efficacy 
of the adaptive SED technique is validated to find the optimum SPID control parameters of portable duodopa 
pump. The control performance of the SPID controller based ASED is evaluated using convergence plot of 
the cost function, the dopamine level of patient’s blood plasma (BP) as well as the quantitative analysis of 
cost function and its component are shown. Based on the results, it is shown that the SPID controller based 
ASED could produce a slight enhancement in reducing the error and improve the control accuracy than the 
conventional PID controller based on the ASED algorithm. 


2. MODELLING OF PORTABLE DUODOPA PUMP 

This section briefly explains the mathematical model of portable duodopa pump taken from [5], 
which is a modified version of the existing Levodopa dose-effect model [24]. Note that the closed-loop 
control of dopamine includes the conversion of Levodopa to dopamine which occurs in the brain. This 
conversion model includes the conversion factor C. In particular, the conversion factor C referring to the 
amount of Levodopa needed to generate 1 ng/mL of dopamine. Based on [5], the maximum value of 
Levodopa of a patient after consuming 125 mg capsule (100 mg of Levodopa and 25 mg of Benserazide) is 
3763 ng/mL and the dopamine range in BP is 10ng/mL to 20 ng/mL for adults. Let’s consider the dopamine 
level that we want to generate is 15 ng/mL, hence the C is: 


Sraa a) 

E g/mL 
Next, the transfer function Gp,(s) that relates plasma level of dopamine M(s) and plasma level of Levodopa 
N(s) is given by: 


M = 
Gpa(s) = yn = Comes (2) 
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where T, (minutes) is referred as recirculation delay. Moreover, the input-output relationships between the 
amounts of Levodopa infused O(s) and plasma level of dopamine M (s) is modeled as Gpx (s): 


M(s) _ Cpxe "15 
O(s) (1+T,s)(14+T2s) 





Gpg(s) = (3) 


where the symbol Cpg is the amplification factor while T,and T, are the time constants (minutes), and T4 is 
the time lag (minutes) needed to start the absorption of Levodopa from the blood. From (2) and (3), the 
change in the level of dopamine after we deliver Levodopa is given by: 


AD = Gpg(s) X Gals) = LE Œ ce-es, (4) 


(1+T,s)(1+T25) 


where AD = D — D,. Here, D, is patient body’s own dopamine level in BP. There are three stages of D, 
which are early stage (7 < D, < 10), Moderate stage (3 < D, < 7) and advanced stage (D, < 3). In this 
study, the coefficients of the model are Cpg = 1418, tT, = 15, Tz = 10, T} = 3.2838 and T, = 36.4380. 
Please refer the details of the model in [5] and [25]. 


3. METHOD 

This section describes the SPID controller design for portable duodopa pump (PDP) using adaptive 
safe experimentation dynamics for Parkinson's diseases. Initially, the statement of problem of the SPID 
controller of a portable duodopa pump is shown. In particular, the SPID controller structure and its control 
parameters are described. Then, the step-by-step guideline is presented to obtain the optimum SPID 
parameters using ASED. 


3.1. Statement of problem 

Figure 1 depicts the SPID control system block diagram for a portable duodopa pump. The 
symbols D, r(t), e(t), z(t), and y(t) are denoted as portable duodopa pump system, reference amount dopamine 
[5], error signal, control input and level of dopamine response, respectively. Note that, the system D is 
obtained from (4), where D = AD + D». 





r(t) e(t) z(t) yt) 
Kspip(s) D 















Figure 1. Block diagram of control system for portable duodopa pump 


Moreover, the SPID controller Ksp;p (S) is given by: 








Ksprp(S) = Kpy + íw + Kays (5) 
where, 

Kov = Kptow — Pease (6) 

Kw = Know — (ear, (7) 

Kav = Katow — ee . (8) 





Note that the (6)-(8) are formulated based on sigmoid function [22]. One of the important 
advantages of the proposed solution is that the sigmoid function ensures a continuous change of the SPID 
parameters according to the change of error e(t). For simplicity of the SPID controller design, we 
introduce A = Kpnign — Kpiow» Ai= Kinign — Kitow and Ag= Kanign — Katow- 
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The purpose of the controller for portable duodopa pump is to make sure the optimal delivery of 
Levodopa to a patient based on the patient requirement with fast response and less overshoot of dopamine 
level. In addition, the level of levodopa infused by the controller is increasing proportionally to the reduction 
in the plasma level of dopamine [5]. Therefore, the cost function for this problem is set as (9): 


J(K,A,a) = wE + w3Ž, (9) 
Where, 

pz S ledt, (10) 

Z= fJlz@VPade, (11) 


for the time duration of [fo, tr]. The symbols tọ and ty are refers to the initial and final time, respectively. 
Based on (9), the symbols K = [Kpiow Kitow Katow |", A= [Ap Ai Aa J", and a =[apy a; aq)" that 
bring to 9 tuning parameters of SPID controller. Note that E and Z can be also defined as norm of error and 
norm of input, respectively. Next, there are two weight coefficients adopted in (9), which are represented by 
the symbols wıeR and w2eR to prioritize the performance index in the multi-cost function. Finally, our 
problem can be stated as: 


Problem 1. From the plant D in Figure 1 and the measured output y(¢) and input z(t) data, obtain the SPID 
control parameters in Kspyp(s) such that the cost function in (9) is reduced. 


3.2. SPID utilizing adaptive safe experimentation dynamics 

The implementation of ASED method to obtain the optimum SPID controller of portable duodopa 
pump system is explained in this section. Initially, the conventional SED algorithm is briefly described. 
Then, the ASED method with its procedure, is shown. Finally, a complete step-by-step guideline of ASED 
method to obtain the optimum SPID controller of portable duodopa pump is presented. 

Next, let the optimization problem given as (12): 


min gw) (12) 


where g:R” > R is a function with the vector of design parameter v € R”. The SED method updates v € R” 
to obtain an optimum solution Ve R”of (12) by using: 


h(i —Kyn) ifn <E, 


13 
vi ifr, >E, ga 


where k = 0,1, .. is number of iteration, v; € R is the ith component of v € R”, and V; E R is the ith 
elements of current best vector Y € R”. The coefficient Kọ is the size of the interval to discover the random 
steps on V; E R, the coefficient E is the probability to change the element of the tuning parameter and 7, E R 
is the random value that is produced uniformly between 0 and 1. The function h in (13) is expressed by: 


Vmax İf Vi — Kgt2 > Vax: 
h(.) =40i-—Kgr if Vmin < Vi — Kgn S Vmax, (14) 
Vmin if vi an Kgn < Vrmin» 


where Vmin and Vmax are the pre-defined upper and lower bounds, respectively, and r, is another random 

value that is produced independently from 7,, in the range of [0, 1]. The procedures for the execution of the 

SED algorithm are given by: 

Step 1: Obtain the Vmin: Vmax» Kg and E values and set the initial design parameter v(0). Evaluate the cost 
function g(v(0)) and set Y = v(0) and g = g(v(0)). 

Step 2: Execute Y = v(k) and g = g(v(k)) when the value g(v(k)) < g otherwise, go to Step 3. 

Step 3: Produce random values r, and r, and obtain the updated equation in (13). 

Step 4: Execute the cost function g(v;(k + 1)). 
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Step 5: If the maximum number of iteration kmay is achieved, the algorithm stop with the optimum 


ter Y := ar min v) . Otherwi t Step 2. 
parameter Snape n sae ) . Otherwise, repeat Step 


Based on the study from [10], the conventional SED algorithms are still insufficient to produce a 
significant convergence accuracy. One of the reason is that the design parameters updated in (13) depend 
only on K, and the random numbers r, and 7, which makes it identical to the basic random search strategy. 
Therefore, in order to solve the above issue, we adopt the Adaptive SED from [10] as the optimization tool in 
finding the optimal SPID controller. In particular, the updated in (13) is modified as (15): 


= (k))-g\ . 
A(v; = Kr) + Kg; (ees) ifr SE, 


= glw(k)-9) : 
Vi + Kgy (222) if Yi >FE, 


v(k +1) = (15) 


where Kg, is a new scalar value that defines the size of the interval to adjust the adaptive mechanism. Note 
that, by adopting (15), the probability of perturbing each element of the tuning parameter is increased, which 
could lead to the extra effort of finding the optimal tuning parameter [10]. 

Finally, the procedure to execute the ASED for SPID control tuning of portable duodopa pump is 
described as: 
Procedure 1: Set the maximum iterations kmax and consider g(v) = J(K,A,q@) and v; = logy;. Note that 


p= [Kpiow Ap &p Kitow Ai &i Katow Aa aal is the tuning parameter vector and wy; = 10”i(i = 
125559): 

Procedure 2: Execute the ASED algorithm in (15). 

Procedure 3: After kmax is obtained, record the optimal tuning parameter V. Finally, execute the SPID 
controller y = [101 1072 --- 1079]! in Figure 1. 


4. RESULTS AND DISCUSSIONS 

The efficiency of the ASED based method in obtaining the optimum value of SPID controller is 
presented in this section. Specifically, the convergence plot response of the cost function, the dopamine level 
in patient’s BP and the statistical analysis of cost function, norm of error and norm of input are demonstrated 
and analyzed. Here, 30 trials are utilized to assess the statistical performances of SPID based on ASED. The 
simulation is executed using the reference r(t): 


r(t)=(15ng/mL), for 0 < t < 900 minutes (16) 


The aim is to obtain the optimum SPID control parameters such that the dopamine sensor can follow 
the pre-defined reference in (16) with fast response and minimum overshoot. The coefficients of ASED for 
tuning SPID are given as K,=0.08, E=0.63, Vmin=0.003, Vma=20 and K,,=0.001, while for tuning PID, the 
coefficients of ASED are given as K,=0.002, E=0.66, Vmin=0, Vma=3 and Kg;=0.0002. The weighting 
coefficients for tuning both SPID and PID are set as wi=100 and w2=1. The initial values of the tuning 
parameters are given as v(0)=[0.14571 0 0 0.00589 0 0 0.00442 0 OJ]. Note that the initial values are 
taken from the value of PID controller tuned by Ziegler Nichols in [5] by guaranteeing a stable response is 
obtained. 

Figure 2 illustrates the response of the cost function convergence plot of SPID controller tuning 
after 175 iterations to produce the best tuning parameters V=[0.1497 0.003 15.0338 0.0035 0.0031 13.2612 
0.0030 0.0031 15.8531]". Note that the convergence response in Figure 2 is the best convergence response 
selected from 30 trials. It proves that the ASED based method can reduce the cost function and produce 
better control accuracy, as shown by the dopamine level response in Figure 3. Here, three of dash lines in 
Figure 3 correspond to the responses of the controller based on initial PID parameters or PID tuned by ZN 
(k=0), while three solid lines refer to optimal PID parameters (k=175) and the other three dash-dot lines are 
referred to optimal SPID parameters (k=175). Three different colors are used to distinguish between each 
stage of PD patients which are, black for early stage, blue for Moderate stage and purple indicates advanced 
stage of PD patients’ response. It shows that the SPID based ASED successfully achieves to improve the 
performance of the duodopa pump at every stage of Parkinson's disease. When we focus on the early stage of 
PD patient output response which was plotted in Figure 3, the SPID-ASED produced very minimal overshoot 
with a peak value of 15.6117 ng/mL as compared to the PID-ASED and the PID-ZN with 15.7933 ng/mL and 
18.4300 ng/mL, respectively. Moreover, the SPID-ASED also produces slightly faster settling time with a 
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value of 124.4099 minutes than the PID-ASED and PID-ZN with values of 134.1324 minutes and 294.9286 
minutes, respectively. A similar pattern can be seen for other stages of PD patient. It proves that SPID based 
ASED tuning method has improved performance control accuracy compared to PID-ASED and PID-ZN 
controllers. 

Furthermore, Table 1 shows the comparative assessments for both PID-ASED and SPID-ASED 
controllers after 30 trials, in terms of the cost function, norm of error, norm of input, and time response 
specifications. Note that the data in Table 1 is taken for the case of PD patients at an early stage. In particular, 
the bold numerical values in Table 1 imply the best performance. Moreover, it demonstrates that the SPID- 
ASED produces slightly better statistical values (in terms of mean, best, and worst) in the cost function and 
norm of error than the PID-ASED. Thence, it proves that the proposed SPID based ASED can produce 
enhancement in the control accuracy, especially on the cost function and the tracking error. 
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Figure 2. Convergence plot of the cost function of SPID-ASED 
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Figure 3. Blood plasma level of dopamine for intra-patient variability 
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Table 1. Statistical performances between SPID-ASED and PID-ASED controllers. 











Performance index SPID-ASED PID-ASED 
Mean 2.796150e+05 2.8373e+05 
J (Kpiow Bp p Kiow Ai 6 Kao ba aa) Worst “280270005 289606005 
Std. 3.436116e+02  2.12112e+03 
Mean 2.77724e+03 2.81845e+03 
E Best 2.77087+03 2.78785e+03 
Normioterror E Worst 2.78366e+03  2.87728e+03 
Std. 3.43382 21.2152 
Mean 1.89077e+03 1.88188e+03 
Norm of input, Ž Best 1.87247e+03 1.87567e+03 
í Worst 1.90862e+03 1.88682e+03 
Std. 7.7523 2.2419 
Settling time (5%) (minutes) 124.4099 134.1324 
: aR ees 3 : Rise time (minutes) 40.5866 40.1805 
Time Response Specifications Peak 0.6117 0.7933 
Steady state 0.0010 7.2340e-09 





5. CONCLUSION 

The SPID controller using the ASED method for a portable duodopa pump system has been 
presented. Simulation results have shown that the ASED-tuned SPID controller has enhanced the control 
accuracy as it successfully improves duodopa pump performance at each PD stage by providing a better 
optimal solution compared to PID-ASED. In particular, early stage statistical analyses of PD patients 
revealed that the proposed SPID controller is able to generate lower cost function values, norm of error and 
norm of input compared to the PID controller. The findings are supported by the response of the blood 
plasma level of dopamine to intra-patient variability. In the future, the SPID-ASED controller can be 
extended for controlling various medical devices, such as a continuous positive airway pressure ventilator 
and Neuromodulator devices. 
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